Python Job: AWS Data Engineer - Python

AWS Data Engineer - Python - PySpark - London - Hybrid - 120K

DataBuzz are recruiting a AWS Data Engineer - Python - PySpark on behalf of a prestigious organisation, who is looking for someone with data engineering experience to help lay the groundwork for market leading data analysis and experimentation in the sporting landscape.

As a AWS Data Engineer - Python - PySpark, you will work closely with data scientists, with responsibilities including not limited to cleaning, transforming, and aggregating data; compiling and installing database systems; writing complex queries; scaling to multiple machines; and putting disaster- recovery systems in place.

As a AWS Data Engineer - Python - PySpark you will be contributing to the development and deployment of new and existing products, you’ll write high-quality code that allows us to put solutions into production and take part in code reviews and paired-programming sessions.

As a AWS Data Engineer - Python - PySpark you will be working as part of a young, enthusiastic and passionate analytics team to deliver insights and analyses to some of the world’s largest sporting teams, leagues and broadcasters.

Essential Skills :

• AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement
• Designing, building, and maintaining large scale data solutions and applications using AWS data and analytics services (or open- source equivalent)
• Experience in Python development (data curation and data validation)
• Should have expertise in using python packages like Pandas.
• Design and build pipelines to convert pandas dataframes into Pyspark

• Hands on experience in handling different types of files using Python/Pyspark
• Good understanding of databases and SQL
• Ability to advocate using the right tech for the right task— you’ll be up to date with the latest technologies and ensure we make the relevant changes when needed Desirable skills & experience (not essential):
• Agile methodology and Azure DevOps
• Passion for and knowledge of several sporting codes, including rugby, cricket, football and motor racing.

#aws #awsdataengineer #python #pyspark #pandas #glue #lambda #datapipelines #data #emr #kedro #airflow

Job Types: Full-time, Permanent

Salary: £70,000.00-£110,000.00 per year

Schedule:

• 8 hour shift

Work authorisation:

• United Kingdom (required)